Method, computer program, and reception apparatus for delivery of supplemental content

ABSTRACT

Reception apparatus, method, computer-readable storage medium, and information providing apparatus for a trigger. The reception apparatus includes a tuner/demodulator and a processor. The tuner/demodulator is configured to receive content included in a transport stream from a content source. The transport stream includes a trigger associated with the content and references information included in the transport stream. The processor is configured to retrieve the trigger from the transport stream, and to retrieve the information from the transport stream based on the reference in the trigger.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present continuation application claims the benefit of priorityunder 35 U.S.C. §120 to application Ser. No. 14/704,554, filed on May 5,2015, which is incorporated herein by reference in its entirety and is acontinuation application of application Ser. No. 13/782,730 (now U.S.Pat. No. 9,113,230), filed on Mar. 1, 2013, which is incorporated hereinby reference in its entirety and claims priority under 35 U.S.C. §119(e)to U.S. provisional patent application No. 61/636,488, filed Apr. 20,2012, which is incorporated herein by reference in its entirety. Thisapplication is related to U.S. provisional patent application No.61/613,880, filed Mar. 21, 2012; and U.S. provisional patent applicationNo. 61/578,631, filed Dec. 21, 2011, which are incorporated herein byreference in their entirety.

BACKGROUND OF THE INVENTION Field of the Invention

Embodiments described herein relate generally to a method,computer-readable storage medium, and reception apparatus for deliveryof supplemental content. More particularly, the embodiments describedherein relate generally to delivery of data required to present thesupplemental content within a broadcast emission.

Background

Modern televisions and set top boxes are capable of performing numerousfunctions in addition to receiving and presenting television broadcasts.Some functions include the display of an electronic programming guide(EPG), widgets that allow a television viewer to pull up web pages andtools right alongside programs being watched on a television, and thelike. Many of these functions require that the television or set top boxreceive additional data.

SUMMARY OF THE INVENTION

According to an embodiment of the present disclosure, there is provideda method of a reception apparatus for processing a trigger. The methodincludes receiving content included in a transport stream from a contentsource. The transport stream includes a trigger associated with thecontent and references information included in the transport stream. Thetrigger is retrieved from the transport stream. Further, the informationis retrieved from the transport stream based on the reference in thetrigger.

Further, according to an embodiment of the present disclosure, there isprovided a non-transitory computer-readable storage medium havinginstructions embedded therein, which, when executed by a computer, causethe computer to perform the method of the reception apparatus, asdiscussed above.

According to an embodiment of the present disclosure, there is provideda reception apparatus. The reception apparatus includes atuner/demodulator and a processor. The tuner/demodulator is configuredto receive content included in a transport stream from a content source.The transport stream includes a trigger associated with the content andreferences information included in the transport stream. The processoris configured to retrieve the trigger from the transport stream, and toretrieve the information from the transport stream based on thereference in the trigger.

Further, according to an embodiment of the present disclosure, there isprovided an information providing apparatus. The information providingapparatus includes a multiplexer and a transmitter. The multiplexer isconfigured to generate a transport stream including content, a triggerassociated with the content, and a trigger parameters table (TPT)referenced by the trigger. The TPT is retrieved by a reception apparatusbased on the trigger and a File Delivery over Unidirectional Transport(FLUTE) File Delivery Table (FDT). The transmitter is configured totransmit the transport stream to the reception apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the invention and many of the attendantadvantages thereof will be readily obtained as the same becomes betterunderstood by reference to the following detailed description whenconsidered in connection with the accompanying drawings, wherein:

FIG. 1 illustrates an exemplary broadcast system including a contentsource, reception apparatus, trigger parameters table (TPT) server,triggered declarative object (TDO) server, and an automatic contentrecognition (ACR) system;

FIG. 2 is a block diagram of an exemplary reception apparatus;

FIG. 3 is a processor-centric block diagram of an exemplary receptionapparatus;

FIG. 4 is an exemplary basic diagram of a content source consistent withcertain embodiments of the present disclosure;

FIG. 5 illustrates a flow diagram of an exemplary method for processinga compact trigger;

FIG. 6 illustrates exemplary triggers and an associated TPT;

FIG. 7 is a block diagram of an exemplary information providingapparatus;

FIG. 8 is an exemplary computer;

FIGS. 9A-9D illustrate different embodiments for accessing supplementalcontent data by the reception apparatus based on the availability of atransport stream and access to one or more communication networks;

FIGS. 10A-10C illustrate exemplary compact triggers;

FIG. 11 is an exemplary diagram depicting delivery of IP packets via adigital television broadcast; and

FIG. 12 is an exemplary diagram depicting the linkage between a ServiceMap Table (SMT) and a File Delivery over Unidirectional Transport(FLUTE) File Delivery Table (FDT).

DETAILED DESCRIPTION

While this invention is susceptible of embodiment in many differentforms, there is shown in the drawings and will herein be described indetail specific embodiments, with the understanding that the presentdisclosure of such embodiments is to be considered as an example of theprinciples and not intended to limit the invention to the specificembodiments shown and described. In the description below, likereference numerals are used to describe the same, similar orcorresponding parts in the several views of the drawings.

In interactive television applications, viewers are offered supplementalcontent, in addition to the program audio and video, that allows them tointeract with the programming in some way. The supplemental contentcould be as simple as an Internet uniform resource locator (URL) thatpoints to a web site that can provide further information about theprogram, item, or service being shown. Or, the supplemental contentcould provide text and graphics that augment the program video. Anexample of the latter is an interactive element that displays aparticular player's updated statistics during the course of a sportingevent.

Often, the behavior or appearance/disappearance of these interactiveelements is dependent on the timing of events within the program.Television receivers which render these objects must be able to receivethe appropriate signaling to know how and when to make the adjustmentsto the display of the interactive elements. The objects which performthis signaling function may be called “triggers” because they act totrigger a certain operation at the designated time. The varieties ofoperations that may be triggered are endless. Simple examples includesuch things as “execute” (start the operation of the interactivefunction), “hide” (remove all visible elements from the display),perform some designated action such as display or update some text orgraphic, and “terminate” (end all operations and release memoryresources).

The trigger itself must be transported from the point in thedistribution chain at which the interactive element is sourced andoperated all the way to the consumer's receiver. A variety of transportmethods are possible for the trigger object. The trigger can be includedin the digital transport multiplex in one or a combination of differentlocations, or it can be provided by an Internet-based server andaccessed by receivers that are Internet-connected.

Possible locations in the digital transport include in video or audio“user data,” within the closed captioning transport, within a descriptorcarried in a program specific information (PSI) table, within adaptationfields of the MPEG-2 Transport Stream packet, embedded in audio, andmodulated within the video itself in luminance or chrominance. In eachcase, small triggers are preferable. For example, a trigger that can berepresented in as few as 30 bytes (or characters of text) offers greaterflexibility in transport and greater efficiency compared to one whosesize might be 100 or more bytes. In embodiments of the presentdisclosure, supplemental content including interactivity is presented inwhich the trigger function is accomplished using a small, “short,” or“compact” trigger.

Referring now to the drawings, FIG. 1 is a block diagram that shows anexemplary broadcast system 2, including a content source 10, a receptionapparatus 20, a trigger parameters table (TPT) server 40, a triggereddeclarative object (TDO) server 50, and an optional automatic contentrecognition (ACR) system 60.

In one embodiment, the content source 10 provides content to thereception apparatus 20 via a terrestrial broadcast. In the case ofaudio/video content, the content is divided into a video elementarystream (ES) and an audio ES corresponding to the video and audioportions of the content. The video ES and audio ES are multiplexed withother data to form a broadcast multiplex, such as an MPEG-2 TransportStream.

As illustrated in FIG. 9A, in one embodiment, the MPEG-2 TransportStream includes one or a combination of a video ES; a digital televisionclosed caption stream; an audio ES, Program-specific Information (PSI);Program and System Information Protocol (PSIP) information as specifiedin ATSC Document A/65, which is incorporated by reference in itsentirety; and IP data packets corresponding to an IP subnet. In oneembodiment, the IP subnet includes one or a combination of one or moreService Signaling Channels (SSC) and one or more File Delivery overUnidirectional Transport (FLUTE) sessions. FLUTE is defined in RFC 3926,which is incorporated by reference in its entirety. Further, thetransfer of non-real-time content delivery via an MPEG-2 TransportStream is described, for example, in “Working Draft: ATSC CandidateStandard: Non-Real-Time Content Delivery,” S13-1-329r18 and ATSCStandard: Non-Real-Time Content Delivery Doc. A/103, May 9, 2012, whichare incorporated herein by reference in their entirety.

In other embodiments, the content source 10 provides the content via atleast one of a satellite broadcast, a cable television transmission, aterrestrial television broadcast, cellular network, and datacommunication network such as a local area network (LAN), wide areanetwork (WAN), or the Internet 30. The content provided by the contentsource 10 includes one or more television programs, without regard towhether the content is a movie, sporting event, segment of a multi-partseries, news broadcast, etc. Further, the content provided by thecontent source 10 may also include advertisements, infomercials, andother program-like content which may not be reported as a program in anEPG.

The broadcast system 2 provides an interactive digital televisionfeature whereby a viewer is presented with supplemental content that isassociated with, and/or synchronized in time to events within, contentprovided by the content source 10. The supplemental content includes oneor a combination of media types such as audio, video, text, or an image,and/or one or more interactive elements and, in one embodiment, iscommunicated to the reception apparatus 20 via one or more broadcastparameters. In one embodiment, the behavior and appearance of thesupplemental content is associated with, and synchronized in time to theevents within, the content.

The manner in which the reception apparatus 20 accesses supplementalcontent, according to embodiments of the present disclosure, depends onvarious factors such as the availability of the transport stream, theavailability of one or more communication networks, and the type ofcontent (e.g., broadcast versus non-real-time content) reproduced by thereception apparatus 20. For example in some scenarios, only theuncompressed audio and video may be provided to the reception apparatus20 for display; the transport stream may not be accessible. In otherscenarios, a “partial” transport stream may be available, meaning thatonly the packets carrying compressed audio and video are present andother packets (carrying, for example the IP subnet, SSC, and FLUTEsession) are not present. FIGS. 9A-9D illustrate four cases: (1) fulltransport stream is available, but a communication network (e.g., theInternet) is not accessible; (2) full transport stream is available anda communication network is accessible; (3) non-real-time (NRT) fileplayback and/or only a partial transport stream is available, and acommunication network is accessible; and (4) the transport stream is notavailable, but a communication network is accessible.

As illustrated in FIG. 9A, in the first case, when supplemental contentdata are included in the transport stream, the reception apparatus 20 isable to access supplemental content via the transport stream, despitenot having access to a communication network. In one embodiment, thesupplemental content data are provided in one or more FLUTE sessions andare referenced and extracted using a FLUTE File Delivery Table (FDT) forexample, in a manner similar to the manner in which non-real timeservices are provided in U.S. Pat. No. 8,099,752, patented Jan. 17,2012, which is incorporated by reference in its entirety. Embodiments ofthe present disclosure, however, utilize the FLUTE/FDT itself, withoutrequiring the use of a non-real-time information table (NRT-IT) or othersimilar “adjunct services table.”

An exemplary method for extracting the supplemental content data isillustrated in FIG. 5, which is discussed in more detail below. Thisallows broadcasters the ability to optionally offer supplementalcontent, and interactive experiences, to users who do not have Internetaccess, but do have access to the transmitted signal (e.g., by means ofan antenna and a tuner-demodulator), by placing supplemental contentfiles within a broadcast file system in addition to, or in lieu of, anInternet server.

As illustrated in FIG. 9B, in the second case, when the full transportstream is available and the reception apparatus 20 has access to acommunication network, the reception apparatus 20 is configured toretrieve a trigger for the supplemental content from the transportstream and supplemental content data based on the trigger via thecommunication network by, for example, accessing the TPT server 40and/or the TDO server 60. In other embodiments, the reception apparatus20 is configured to retrieve the supplemental content data from the fulltransport stream as an alternative, or in addition, to retrieving thesupplemental content data using the communication network.

When the reception apparatus 20 is configured to retrieve thesupplemental content data from both the full transport stream and thecommunication network, in one embodiment, the reception apparatus 20 isconfigured to attempt to retrieve the supplemental content data firstfrom one of the full transport stream and the communication network and,if unsuccessful, to subsequently retrieve the supplemental content datafrom the other of the full transport stream and the communicationnetwork. In another embodiment, both retrieval methods may be initiatedsimultaneously. The reception apparatus 20 can conclude both methodswhen the content data is retrieved via either.

As illustrated in FIG. 9C, in the third case, when the receptionapparatus 20 plays back an NRT file and/or only a partial transportstream (e.g., only the video/audio elementary and closed captionstreams) is available, the reception apparatus 20 retrieves a triggerfrom the partial transport stream and the supplemental content data fromthe communication network based on the trigger. It is noted that theclosed caption stream need not be available to the reception apparatus20 when the trigger is included in another accessible location withinthe transport stream. However, access to other parts of the transportstream such as the PSI table may be required based on the location ofthe trigger. For example, the reception apparatus 20 obtainssupplemental content data such as one or a combination of a TPT from theTPT server 40 and a TDO from the TDO server 60.

As illustrated in FIG. 9D, in the fourth case, when the transport streamis not available and the reception apparatus 20 has access to acommunication network, the reception apparatus 20 in one embodimentobtains the trigger from an ACR response provided by the ACR system 60,as described for example in U.S. provisional patent application No.61/549,775, filed Oct. 21, 2011, which is incorporated by reference inits entirety.

As noted above, the manner in which the reception apparatus 20 accessessupplemental content data varies based on factors such as theavailability of the transport stream, the type of content being playedback, and the accessibility of one or more communication networks. Inone embodiment, the reception apparatus 20 is configured to handle eachof the cases noted above. In other embodiments, the reception apparatusis configured to handle any one or a combination of the above-notedcases.

The reception apparatus 20 receives the content provided by the contentsource 10 and presents the content on a display 350, as illustrated inFIG. 3. In one embodiment, the display 350 is an integral part of thereception apparatus 20 such as a television set. Alternatively, thedisplay 350 may be external to the reception apparatus 20 such as atelevision set connected to a set top box.

According to one embodiment, the reception apparatus 20 includes aDeclarative Object (DO) Engine that accepts declarative objects (DOs)and renders them along with the content (e.g., audio/video content of aprogram) received from the content source 10. The DO Engine renders a DOin response to a specific request from a user or in response to atrigger event. A DO that is rendered in response to a trigger event isreferred to as a triggered declarative object (TDO).

The TDO is a downloadable software object created by a content provider,content creator, or service provider, which includes declarative content(e.g., text, graphics, descriptive markup, scripts, and/or audio) whosefunction is tied in some way to the content it accompanies. Anembodiment of the TDO is described in U.S. application Ser. No.12/959,529 filed Dec. 3, 2010 entitled “Announcement of TriggeredDeclarative Objects” to Blanchard et al. which is hereby incorporated byreference in its entirety. However, the TDO is not limited to thestructure described in Blanchard et al. since many attributes definedtherein as being a part of a TDO could be situated in a trigger or viceversa or not present at all depending upon the function and triggeringof a particular TDO.

The TDO is generally considered as “declarative” content to distinguishit from “executable” content such as a Java applet or an applicationthat runs on an operating system platform. Although the TDO is usuallyconsidered to be a declarative object, a TDO player (e.g., the DOEngine) typically supports a scripting language that is anobject-oriented programming language. The TDOs, in examples shownherein, are received from a content or service provider in advance ofthe time they are executed so that the TDO is available when needed.Moreover, an explicit trigger signal may not be necessary and a TDO maybe self-triggering or triggered by some action other than receipt of atrigger signal. Various standards bodies may define associatedbehaviors, appearances, trigger actions, and transport methods forcontent and metadata for a TDO. Additionally, requirements regardingtiming accuracy of TDO behaviors relative to audio/video may be definedby standards bodies.

The trigger is a data object, which is optionally bound to a particularitem of content (e.g., a television program) that references a specificTDO instance, or set of TDO instances, by the use of a file name ordirectory path identifier for an object or objects that have alreadybeen downloaded. Certain TDOs will only make sense in conjunction withcertain content. An example is a TDO that collects viewer response data,such as voting on a game show or contest.

In one embodiment, the DO Engine receives triggers tied to coincide withvarious points (e.g., trigger events) in the content such as a scenechange or the beginning or ending of an ad segment. The triggers aredivided into two command types: (1) those that are processed by the DOEngine (referred to as triggers associated with type 1, lifecycle, or DOEngine commands), and (2) those that are passed by the DO Engine to theTDO for processing (referred to as triggers associated with type 2 or DOevent commands). The triggers associated with a type 1 command areassociated with, for example, commands to be executed by the DO Engine.The triggers associated with a type 2 command are associated, forexample, with parameters (e.g., commands, data, etc.) to be processedwithin the DO itself to effect changes in appearance, behavior, or stateof associated supplemental content.

As noted above, a trigger may be transported within a broadcast emissionstream as described, for example, in U.S. patent application Ser. No.13/216,375, which is incorporated herein by reference in its entirety.For example, a trigger may be transported in a Packetized ElementaryStream (PES) in an MPEG-2 Transport Stream (TS). A trigger may also betransported via other paths such as the Internet. In one embodiment,when the trigger is not available via the broadcast emission stream, thereception apparatus 20 acquires the trigger via the ACR system 60 by,for example, sending A/V samples of the content being received by thereception apparatus 20 to the ACR system 60. In other embodiments, thetrigger is embedded in the content itself. For example, the trigger maybe embedded in an audio or a video portion of the content and recoveredby processing of the decoded audio or the video in the receptionapparatus 20.

To reduce the size of the trigger, a subset or all of the parametersassociated with the trigger are provided to the reception apparatus 20separately, instead of being included in the trigger itself. Forexample, as illustrated in FIG. 9A, the parameters associated with thetrigger are provided in a TPT transported in a FLUTE session included inthe transport stream. The TPT can also be provided in other portions ofthe transport stream such as along with EPG data, provided via theInternet by the TPT server 40, and the like.

The TPT includes a primary key (e.g., a tag element) that associateseach element (row) in the table with an associated trigger event. Eachtrigger, in turn, will refer to a particular event in the TPT by meansof this key.

In one embodiment, the reception apparatus 20 is configured to receiveupdated versions of a TPT when available. The capability to receive anupdated version of the TPT provides increased flexibility in providingtrigger events when it is difficult to determine the exact timing oftrigger events ahead of time, such as in the case of live programming.During the live programming, the TPT can be updated to include timinginformation once it has been determined. For example, updated versionsof the TPT may include modified or new timing information associatedwith a trigger for displaying supplemental content during the liveprogramming. In another example, the TPT can be updated to refer todifferent content based on the outcome of the live event. An example ofa method for updating the TPT is via the exemplary compact triggerillustrated in FIG. 10C. However, it is noted that the TPT need notactually be updated with the information included in the compact triggerto execute a command associated with the associated scheduled event.

In another embodiment, the TPT remains unchanged as the programprogresses. The timing of execution of specific interactive events isdetermined by the appearance of a trigger referencing a specific event.When the receiving apparatus 20 receives a trigger, the event referencedin the TPT is executed. An example of the trigger referencing thespecific event is the exemplary compact trigger illustrated in FIG. 10B.

While some forms of the trigger can indicate that the time is right forthe TDO to perform a certain action, a series of timed actions can beplayed out without a trigger. The TPT optionally provides timinginformation for various interactive events relative to “media time.”Each item of interactive content has a timeline for its playout; aninstant of time on this timeline is called media time. For example, a30-minute program may have an interactive event at media time tenminutes and 41 seconds from the beginning of the program, or media time10:41. The TPT can include an entry indicating the details of the eventthat is to occur at time 10:41. Once the reception apparatus 20determines the current timing relative to the start of the program, itcan use the TPT to play out all subsequent events.

In one embodiment, the reception apparatus 20 determines the media timebased on the exemplary compact trigger illustrated in FIG. 10A. Forexample, the reception apparatus 20 determines the media time internallyand uses the media time defined in the compact trigger forsynchronization purposes or as a reference point to determine theelapsed time at any point of the received content (e.g., a televisionprogram). It should be noted that the media time is not limited to theinclusion of minutes and seconds and can use any other increments oftime or reference points such as frames to designate the timing of theevents.

The reception apparatus 20 may determine the availability of an updatedTPT by referring to a non-real-time (NRT) file in a FLUTE session, suchas a file version number indicated in a Transport Object Identifier(TOI). In another embodiment, the reception apparatus 20 periodicallyaccesses a source of the TPT, such as a predetermined FLUTE session, todetermine whether a new TPT is available.

FIG. 2 illustrates an embodiment of the reception apparatus 20. Thereception apparatus 20 is a digital television receiver device that isincorporated into a television set or a set top box. The receptionapparatus 20 includes a tuner/demodulator 202, which receives contentfrom one or more content sources such as a terrestrial broadcast or acable television transmission. The reception apparatus 20 may also, oralternatively, receive content from a satellite broadcast. Thetuner/demodulator 202 receives a transport stream (TS), which isdemultiplexed by the demultiplexer 206 into audio and video (AN)streams. The audio is decoded by an audio decoder 210 and the video isdecoded by a video decoder 214. Further, uncompressed A/V data may bereceived via an uncompressed A/V interface (e.g., a HDMI interface) thatcan be selectively utilized.

In one embodiment, the TS includes ancillary information such as one ormore of caption data and supplemental content data such as TDOs,triggers, TPTs, etc., which are separated out by the demultiplexer 206.However, the A/V content and/or the ancillary information may bereceived via the Internet 30 and a network interface 226.

A storage unit 230 is provided to store NRT or Internet-deliveredcontent such as Internet Protocol Television (IPTV). The stored contentcan be played by demultiplexing the content stored in the storage unit230 by the demultiplexer 206 in a manner similar to that of othersources of content. The storage unit 230 may also store one or moreTDOs, triggers, and TPTs acquired by the reception apparatus 20.

The reception apparatus 20 generally operates under control of at leastone processor, such as CPU 238, which is coupled to a working memory240, program memory 242, and a graphics subsystem 244 via one or morebuses (e.g., bus 250). The CPU 238 receives closed caption data from thedemultiplexer 206 as well as any other information such as TDOannouncements and EPGs used for rendering graphics, and passes theinformation to the graphics subsystem 244. The graphics outputted by thegraphics subsystem 244 are combined with video images by the compositorand video interface 260 to produce an output suitable for display on avideo display.

Further, the CPU 238 operates to carry out functions of the receptionapparatus 20 including the processing of related triggers, TDOs, TPTs,and browser operations. The browser operations include accessing aservice specified by a URL given by the TDO or trigger. The CPU 238further operates to execute script objects (control objects) containedin the TDO, its trigger(s), etc., using for example the DO Engine.

Although not illustrated in FIG. 2, the CPU 238 may be coupled to anyone or a combination of the reception apparatus 20 resources tocentralize control of one or more functions. In one embodiment, the CPU238 also operates to oversee control of the reception apparatus 20including the tuner/demodulator 202 and other television resources.

A more processor-centric view of the reception apparatus 20 isillustrated in FIG. 3. Memory and storage 230, 240, and 242 are depictedcollectively as memory 310. Further, a processor 300 includes one ormore processing units such as CPU 238. Similarly, the variousdemodulators, decoders, etc., that initially process digital televisionsignals are collectively depicted as television receiver/tuner 320. Thereception apparatus 20 further includes a remote controller 360 whichcommunicates with a remote controller receiver interface 340.Additionally, the display 350 is connected to a display interface 330,which includes for example the uncompressed A/V interface and/orcompositor 260, and is either a display integral to the receptionapparatus 20 as in a television set or a connected display device as inthe case where the reception apparatus 20 is integrated into a set-topbox.

Memory 310 contains various functional program modules and data. Thememory 310 stores the data used by the reception apparatus 20. Thememory 310 within the reception apparatus 20 can be implemented usingdisc storage form as well as other forms of storage such asnon-transitory storage devices including for example network memorydevices, magnetic storage elements, magneto-optical storage elements,flash memory, core memory and/or other non-volatile storagetechnologies. The term “non-transitory” is a limitation of the mediumitself (i.e., tangible, not a signal) as opposed to a limitation on datastorage persistency (e.g., RAM vs. ROM). When a TDO 316 is received, theTDO 316 is stored in the memory 310. The TDO execution is carried out bya DO Engine 312. The TDO, when executed by the DO Engine 312 presentssupplemental content based on one or more triggers and/or TPT entriesassociated with the TDO. The memory 310 also stores a TPT 318, which inone embodiment, defines one or more parameters for each triggerassociated with the TDO.

Referring now to FIG. 4, a basic diagram of the content source 10 (e.g.,a service provider such as a broadcaster) is depicted. Generallyspeaking, a single service provider may provide multiple programs overone or more transport streams. For example, a transport stream caninclude content programming for both channel 5 and channel 6, or in theATSC system, for both channels 4.1 and 4.2. The audio, video, andcaption data are provided to an encoder which encodes the data intopackets suitable for distribution, including caption data packets. Asshown, Program A and Program B are encoded by encoders 402 and 404 whichare then provided to a transport stream multiplexer 410. Furthersupplemental content data for the programs are provided as IP packetsfor the respective program. PSI/PSIP data are also provided to thetransport stream multiplexer 410. The PSI/PSIP data, in one embodiment,are generated by a PSI/PSIP generator 406. In another embodiment, thePSI data for each of the programs is generated by their respectiveencoders, and only the PSIP data is generated by the generator 406. Thetransport stream multiplexer 410 then provides an output that can beprocessed for distribution via a physical channel medium such as aterrestrial, cable, or satellite broadcast.

FIG. 5 provides an overview of an exemplary method for processingtriggers by, for example, the reception apparatus 20. In step S502, thereception apparatus 20 receives content (e.g., a television program) bytuning to the content included in a transport stream from a contentsource, such as the content source 10. The received content is presentedto the user of the reception apparatus 20, in step S504. In step S506,the reception apparatus 20 retrieves a Service Map Table (SMT) from aService Signaling Channel (SSC) corresponding to the content beingpresented. The SSC is provided in an IP subnet included in the transportstream. In one embodiment, the reception apparatus 20 accesses the SSCthrough a Terrestrial Virtual Channel Table (TVCT) included in the PSIP,an associated Program Association Table (PAT), an associated Program MapTable (PMT), and a Digital Storage Media Command and Control (DSM-CC)addressable section to access the IP subnet.

While FIG. 5 depicts a sequence of process steps, it should be notedthat the equivalent result may be obtained by performing some of thesteps in a different order. For example, a reception apparatus 20 couldretrieve the SMT before displaying any received content on the display(step S506 executed before S504). As another example, the retrieval ofthe compact trigger in step S510 could precede any of steps S504 throughS508 without any effective change in the results. The necessary steps,in general terms, are to retrieve the compact trigger, match it with afile or files in the FLUTE FDT, and to retrieve the associated filesfrom the FLUTE session. Preliminary to recovery of files from the FLUTEsession, the reception apparatus 20 must identify the transport streampackets carrying the IP subnet, access the Service Signaling Channel tofind the Service Map Table, and process the SMT to find the IP addressand port of the FLUTE session.

As illustrated in FIG. 12, in one embodiment, the reception apparatus 20retrieves an SMT 1310 by identifying packets associated with apredetermined identifier such as a predetermined IP address/Port number(e.g., IP=224.0.23.60, Port=4937). The SMT 1310 is linked to a FLUTE FDT1320 via one or a combination of a destination IP address, port number,and FLUTE Transport Session Indicator (TSI) value. Accordingly, thereception apparatus 20 determines an IP address/Port number of any FLUTEsessions associated with the presented content based on the SMT.

In step S510, the reception apparatus 20 receives a compact triggerassociated with the received content. As noted above, the compacttrigger can be included in the digital transport multiplex in a varietyof different locations. In one embodiment, the compact trigger isdelivered within a digital television closed caption channel associatedwith the content being displayed by the reception apparatus 20, asdescribed for example in U.S. provisional patent application No.61/613,869, filed Mar. 21, 2012, which is incorporated herein in itsentirety. In other embodiments, the compact trigger is included in theIP subnet such as a FLUTE session, acquired from the ACR system 60, etc.

An FLUTE File Delivery Table (FDT) is downloaded in step S512. The FLUTEFDT is an IP packet-based directory of files that includes a contentidentifier that identifies content present in IP packets elsewhere inthe IP packet stream. The FDT identifies entries via “Content-Location”which is a uniform resource identifier (URI) as described for example,in RFC 2396, which is incorporated by reference in its entirety.

As illustrated in FIGS. 9A and 12, the FDT includes one or more“Content-Location” entries. The “Content-Location” entry is used by acompact trigger to reference one or more content items in the FDTassociated with the presented content. In one embodiment, metadatacarried in the FLUTE FDT is used as linkage between the compact triggerand the FDT. Specifically, using the directory portion of the compacttrigger (the portion excluding the “query” portion [“?” and termsfollowing]) to match against a “Content-Location” entry in the FDT. Inother embodiments, another field in the FDT could be used to perform thematch, Thus, the compact trigger can reference one or more content itemsin an FDT associated with the presented content.

As described above, in one embodiment, the TPT is delivered in a FLUTEfile structure within the broadcast multiplex, within an IP subnet,where IP packets are tunneled within MPEG-2 Transport Stream packets. Instep S514, the reception apparatus 20 processes the compact trigger andretrieves a TPT from a FLUTE session based on the compact trigger andthe FDT. For example, the reception apparatus 20 uses the domainname+program ID portion of the compact trigger to reference contentcarried in an FLUTE session. Specifically, the reception apparatus 20determines a corresponding content identifier in the FDT to identify thelocation of the referenced content.

In step S516, the reception apparatus 20 processes the TPT to identifynecessary resources, including referenced supplemental content data suchas interactive elements including TDOs, other file-based multimediacontent, and data. As illustrated in FIG. 9A, for example, an embodimentof the TPT includes identifiers (e.g., a TDO URL) that are also matchedwith a “Content-Location” entry in the FDT to identify a location of thecorresponding supplemental content data (e.g., TDO) in the IP subnet.The necessary resources are retrieved from the broadcast multiplex instep S518. The retrieval of the necessary resources may or may not beresponsive to the receipt of subsequent triggers by the receptionapparatus 20. Subsequently, the reception apparatus 20 continues toprocess compact triggers from the caption stream.

In the exemplary method of FIG. 5, by retrieving the compact trigger,TPT, and other supplemental content data such as referenced interactiveelements (e.g., TDOs, other file-based multimedia content and data), andany other necessary information from the broadcast multiplex,supplemental content can be provided to a user that may or may not haveInternet access. Thus, embodiments of the present disclosure overcome aproblem wherein a user desiring to access supplemental content has noInternet access, but does have access to the broadcast transport stream.Delivery of the supplemental content (e.g., all files) in FLUTE in thebroadcast emission solves this problem while preserving the benefits ofusing a compact trigger and TPT mechanism.

In one embodiment, the compact trigger provides one or a combination ofthe following functions: (1) identifies the location of the TPT, (2)indicates media timing (i.e., where in playout we are), (3) identifiesan event to execute now or later, and (4) includes the capability ofindicating a parameter to smooth server peak load. Further, in oneembodiment, the compact trigger includes one or a combination of thefollowing contents: (1) URL of the TPT Server or any other identifier ofthe TPT Server, or an identifier of an entry in an FDT (e.g.,“Content-Location” entry), (2) media time, (3) trigger event ID, (4) newtime of specified TPT event, and (5) “diffusion timing” to reduce thepeak load on the Internet servers.

The diffusion timing is included in the compact trigger when a largenumber of receivers need to access content at the same time over acommunication network. Accordingly, when the content is available viaboth the transport stream and over the communication network, thereception apparatus 20 in one embodiment disregards the diffusion timinginformation when retrieving the content from the transport stream. Forexample, a first instance of a compact trigger for an advertisement orprogram may direct all receivers tuned to that channel to access one ormore files from a server at the same time. The diffusion timing allowsthe requests from the receivers to be spread out while ensuring that theone or more files are delivered to each of the receivers in a timelymanner.

Further, the diffusion timing information may or may not be included insubsequent compact triggers for the advertisement or program. Thediffusion timing information may not be needed in subsequent triggerssince all the receivers would already have downloaded the one or morefiles, the exception being receivers that have just tuned into theadvertisement or program.

An exemplary format of the compact trigger is as follows:

-   -   xbc.tv/7a1?mt=200909

In the exemplary format, “xbc.tv” refers to a domain name registered toan entity that will provide content associated with the compact trigger,such as interactive elements. “/7a1” refers to a name/directory spacemanaged by a registered owner of the domain. That is, “/7a1” is alocation of the relevant content within the designated domain. In oneembodiment, “/7a1” corresponds to a program ID portion of the compacttrigger. Thus, “xbc.tv/7a1” identifies a server/directory where theassociated content (e.g., the interactive elements, a TPT, etc.) will befound. When the compact trigger is used to access supplemental contentdata included in the transport stream and/or the supplemental contentdata is only provided in the transport stream, “xbc.tv/7a1” need notidentify an actual server/directory where the associated can be found.

The “?mt=200909” term corresponds to a parameter portion, which is usedto identify for example the media time, event (e.g., trigger event ID),timing updates (e.g., new time of specified TPT event), diffusiontiming, etc. The “mt” portion identifies the particular term; in thiscase, it is a “media time” parameter. Generally speaking, a variety ofdifferent query terms may be defined for the compact trigger in additionto those mentioned here. The command identifier portion is not limitedto two characters; it may be one or more characters in length.

In addition, multiple different query terms may be included in thecompact trigger, as specified in the Internet standards. When multiplequery terms are present in the URI, each is separated from the other byan ampersand (“&”) character.

In one embodiment, the parameter portion of the compact trigger does notinclude any parameters. An exemplary format of such a compact trigger isas follows: xbc.us/9b2. A compact trigger without any parameters can beuseful in situations such as when the content provider wants topre-notify one or more receivers that they should collect the tables orany other information in the referenced directory because they likelywill be needed in the short-term. In some embodiments of the presentdisclosure, a compact trigger without any parameters is used to identifya “Content-Location” entry in the FDT.

Exemplary compact triggers are illustrated in FIGS. 10A-10C. FIG. 10Aillustrates a first compact trigger for establishing media timing. Inone embodiment, the reception apparatus 20 uses the media timing as areference to track an elapsed time of currently received content and todetermine the location of an associated TPT. Exemplary usages of thefirst compact trigger include as a response from an ACR server, periodicbroadcasts throughout a program to allow receivers to synchronize andpre-load interactive content, and live and pre-authored content.

FIG. 10B illustrates a second compact trigger for a live event. When thereception apparatus 20 receives the second compact trigger, thereception apparatus 20 causes the TPT event identified in the trigger_idto be immediately executed.

FIG. 10C illustrates a third compact trigger for signaling upcomingevent timing. When the third compact trigger is received by thereception apparatus 20, the reception apparatus 20 schedules executionof a TPT event identified in the trigger_id based on the event time. Inone embodiment, the execution of the TPT event is scheduled for when themedia time of the received content is equal to the event time defined inthe third compact trigger. Exemplary usages of the third compacttriggers include live events and periodic broadcasts throughout aprogram to update timing events in the TPT.

FIG. 6 illustrates an example of a TPT that is retrieved from thetransport stream in response to receipt of a trigger identifying the TPT(e.g., trigger 604A). As illustrated in FIG. 6, a TS 602 carryingcontent has associated with it a plurality of events associated with,for example, user interactivity and/or the display of additionalcontent. Each event has one or more corresponding triggers or entries inthe TPT. Further, in one embodiment, each of the triggers is associatedwith a TDO.

As noted above, in one embodiment, the triggers are divided intotriggers associated with two different types of commands. A triggerassociated with a type 1 command is processed by the DO Engine, while atrigger associated with a type 2 command is processed by a TDO. In FIG.6, triggers 604A and 604E are examples of triggers associated with type1 commands, and triggers 604B-604D are examples of triggers associatedwith type 2 commands. Triggers associated with either type 1 or type 2commands may be used to retrieve a TPT from an FLUTE session, asdescribed above. As illustrated in FIG. 9A, for example, the TPT itselfcan contain a reference to the FDT to retrieve an associated TDO from anFLUTE session.

In one embodiment, triggers associated with a type 2 command areassociated with a row (or element) in the TPT, such as TPT 606, andinclude a reference to a specific entry in the TPT using, for example, atag value. However, the reference to the TPT entry is not limited to atag value and can be any symbol or representation that can be used toreference an entry in the TPT. Certain triggers such as a subset or allof the triggers associated with type 1 commands (e.g., triggers 604A and604E), or a subset or all of the triggers associated with type 2commands, need not have corresponding entries in the TPT correspondingto the trigger_ids identified in the respective triggers.

When receiving the trigger associated with a type 1 command, the DOEngine 312 performs a command identified by that trigger. For example,when the reception apparatus 20 receives a trigger 604A, the receptionapparatus 20 retrieves a TPT associated with a “Content-Location”matching the TPT URL from the transport stream, if necessary. Subsequenttriggers including the TPT URL can be used to establish play out timing(e.g., triggers 604B, 604C, and 604E). The trigger used to retrieve theTPT may or may not include media time information.

As mentioned, the function of the trigger may, in addition toidentifying the location of the TPT, be only to establish the playouttiming of the content it accompanies. Pre-produced (non-live)programming will likely use this model. In such a case, triggers carrymedia time samples (e.g., triggers 604B, 604C, 604E) that the receptionapparatus 20 uses to synchronize its playout clock. The TPT includesreferences to specific values of media time associated with differentinteractive events. For example, the TPT could indicate that event_id 18should be executed when media time value Tb (e.g., 977,803 milliseconds)is reached. The event associated with event_id value 18 may be either atype 1 or a type 2 command.

Any other tag values, symbols, or representations may be reserved for DOEngine commands. Further, in other embodiments, the triggers associatedwith a type 1 command may refer to the TPT 606 or another TPT to provideany parameters required to execute a command. For example, when thetrigger is associated with a type 1 command that is “load TDO,” thetrigger includes the location (e.g., a URL), or a reference to thelocation (e.g., entry in a TPT), of the TDO so that it can be acquiredby the reception apparatus 20. That is, a trigger associated with a type1 command may include a reference to an entry in a TPT that identifiesthe location of a TDO such as the entry associated with tag value 21and/or other necessary data to be retrieved and executed.

The DO Engine extracts a tag value for the trigger associated with atype 2 command and provides the extracted tag value to a currentlyexecuted TDO. The TDO uses the tag value to determine at least oneparameter that is associated with the trigger. Then, as noted above, theTDO performs a function based on the retrieved at least one parameter.In another embodiment, the DO Engine provides the at least one parameterto the TDO.

The TPT 606 illustrated in FIG. 6 contains references to image files.Additional examples of the TPT are illustrated in U.S. provisionalpatent application No. 61/578,631. As illustrated in FIG. 6, one graphicis associated with each tag value 16, 18, and 19. However, the TPT 606is not so limited and can refer to one or a combination of differentmedia types such as audio, video, or an image, and/or one or moreinteractive elements. Further, as noted above, predetermined tag values(e.g., below 16) may be specified in a standard as commands to beexecuted by the DO Engine.

For example, when the reception apparatus 20 receives a trigger 604Bwith a tag value of 16, the DO Engine passes the tag value 16 to thecurrently executing TDO. The DO Engine passes the tag value by calling aTrigger API function and delivers the tag value to the TDO. The TriggerAPI function may be included in the DO Engine or a separate programmingcomponent of the reception apparatus 20. The TDO consults the TPT 606and determines the parameters associated with the trigger are“product1.jpg” and the numbers 104 and 226. In one embodiment, thefunction performed by the TDO based on the determined parametersincludes rendering the image file “product1.jpg” at location X, Y (104,226) on the display 350.

The TPT, however, is not limited to including information on image filesand position, and can include other parameters such as (as mentioned) amedia time that designates the timing of any given interactive events,validity information for defining an expiration date of the trigger,capability codes that allow the reception apparatus 20 to determinewhether it is capable of providing the supplemental content associatedwith the TPT or a specific TPT entry, etc. For example, the TPT mayinclude one or more capability codes that indicate the TPT can only beprocessed by a reception apparatus supporting “ATSC 2.7+,” a minimumrequirement code such as support for certain media formats and decoders,essential and non-essential capabilities, etc.

Note that, in one embodiment, the DO Engine itself does not try tointerpret anything carried in a given row of the TPT instance, such asthe row identified with Tag Value 19 in TPT 606. The informationcontained in the TPT instance is known and interpretable only to the TDOit is designed to work with. Therefore, the number and types ofparameters included in a TPT may be customizable based on therequirements of an associated TDO. In other words, the TPT is notlimited to including a predetermined set of parameters and may containany parameter that is required by a particular TDO.

FIG. 7 illustrates an information providing apparatus 700, which may beincluded in the content source 10. As illustrated in FIG. 7, theinformation providing apparatus 700 includes a memory 710 and acommunication unit 720. The memory 710 can be implemented using discstorage form as well as other forms of storage such as non-transitorystorage devices including for example network memory devices, magneticstorage elements, magneto-optical storage elements, flash memory, corememory and/or other non-volatile storage technologies. Further, thecommunication unit 720 can be implemented using any one or a combinationof a terrestrial broadcast transmitter, a cable broadcast transmitter, asatellite uplink transmitter, a network interface (e.g., WLAN card,Ethernet card, etc.), or the like.

The memory 710 is configured to store supplemental content data such asa TPT, TDO, and the like. In one embodiment, the TPT is associated withat least one TDO and includes at least one parameter associated with atrigger event. The communication unit 720 provides the TPT stored in thememory 710 to the reception apparatus 20. For example, the communicationunit 720 provides the TPT to the reception apparatus 20 via the TS.

FIG. 8 is a block diagram showing an example of a hardware configurationof a computer 800 configured to function as any one or a combination ofthe content source 10, reception apparatus 20, TPT server 40, TDO server50, ACR system 60, and information providing apparatus 700.

As illustrated in FIG. 8, the computer 800 includes a central processingunit (CPU) 802, read only memory (ROM) 804, and a random access memory(RAM) 806 interconnected to each other via one or more buses 808. Theone or more buses 808 is further connected with an input-outputinterface 810. The input-output interface 810 is connected with an inputportion 812 formed by a keyboard, a mouse, a microphone, remotecontroller, etc. The input-output interface 810 is also connected to aoutput portion 814 formed by an audio interface, video interface,display, speaker, etc.; a recording portion 816 formed by a hard disk, anon-volatile memory, etc.; a communication portion 818 formed by anetwork interface, modem, USB interface, fire wire interface, etc.; anda drive 820 for driving removable media 822 such as a magnetic disk, anoptical disk, a magneto-optical disk, a semiconductor memory, etc.

According to one embodiment, the CPU 802 loads a program stored in therecording portion 816 into the RAM 806 via the input-output interface810 and the bus 808, and then executes a program configured to providethe functionality of the one or combination of the content source 10,reception apparatus 20, TPT server 40, TDO server 50, ACR system 60, andinformation providing apparatus 700

The various processes discussed above need not be processedchronologically in the sequence depicted as flowcharts; the steps mayalso include those processed parallelly or individually (e.g., inparalleled or object-oriented fashion).

Also, the programs may be processed by a single computer or by aplurality of computers on a distributed basis. The programs may also betransferred to a remote computer or computers for execution.

Furthermore, in this specification, the term “system” means an aggregateof a plurality of component elements (apparatuses, modules (parts),etc.). All component elements may or may not be housed in a singleenclosure. Therefore, a plurality of apparatuses each housed in aseparate enclosure and connected via a network are considered a network,and a single apparatus formed by a plurality of modules housed in asingle enclosure are also regarded as a system.

Also, it should be understood that this technology when embodied is notlimited to the above-described embodiments and that variousmodifications, variations and alternatives may be made of thistechnology so far as they are within the spirit and scope thereof.

For example, this technology may be structured for cloud computingwhereby a single function is shared and processed in collaboration amonga plurality of apparatuses via a network.

Also, each of the steps explained in reference to the above-describedflowcharts may be executed not only by a single apparatus but also by aplurality of apparatuses in a shared manner.

Furthermore, if one step includes a plurality of processes, theseprocesses included in the step may be performed not only by a singleapparatus but also by a plurality of apparatuses in a shared manner.

Numerous modifications and variations of the present disclosure arepossible in light of the above teachings. It is therefore to beunderstood that within the scope of the appended claims, the inventionmay be practiced otherwise than as specifically described herein.

1. (canceled)
 2. A reception apparatus, comprising: circuitry configuredto receive content from a broadcast source; receive parameterinformation prior to providing supplemental content associated with thecontent, the parameter information including location informationassociated with the supplemental content and timing information; obtainthe supplemental content based on the location information; and providethe supplemental content at a timing determined based on the timinginformation.
 3. The reception apparatus according to claim 2, whereinthe circuitry is further configured to: receive, from the broadcastsource, triggering information; and retrieve the parameter informationbased on a resource location indicated by the received triggerinformation.
 4. The reception apparatus according to claim 2, whereinthe circuitry is further configured to: retrieve the triggeringinformation from a predetermined location of a transport stream.
 5. Thereception apparatus according to claim 2, wherein the circuitry isfurther configured to: retrieve the triggering information from adigital television caption stream.
 6. The reception apparatus accordingto claim 1, wherein the circuitry is further configured to: receive theparameter information via a unidirectional transport session.
 7. Thereception apparatus according to claim 1, wherein the parameterinformation further includes additional data, and the circuitry isconfigured to provide the supplemental content further based on theadditional data included in the parameter information.
 8. The receptionapparatus according to claim 1, wherein the parameter informationfurther includes capability information indicating capabilityrequirements for providing the supplemental content, and the circuitryis further configured to determine whether the reception apparatus iscapable of providing the supplemental content based on the capabilityinformation.
 9. A method of providing supplemental content by areception apparatus, comprising: receiving content from a broadcastsource, the supplemental content being associated with the content;receiving, by circuitry of the reception apparatus, parameterinformation prior to providing the supplemental content, the parameterinformation including location information associated with thesupplemental content and timing information; obtaining, by the circuitryof the reception apparatus, the supplemental content based on thelocation information; and providing the supplemental content at a timingdetermined based on the timing information.
 10. The method according toclaim 9, further comprising: receiving, from the broadcast source,triggering information; and retrieving the parameter information basedon a resource location indicated by the received trigger information.11. The method according to claim 10, further comprising: retrieving thetriggering information from a predetermined location of a transportstream.
 12. The method according to claim 10, further comprising:retrieving the triggering information from a digital television captionstream.
 13. The method according to claim 9, further comprising:receiving the parameter information via a unidirectional transportsession.
 14. The method according to claim 9, wherein the parameterinformation further includes additional data, and providing thesupplemental content is performed further based on the additional dataincluded in the parameter information.
 15. The method according to claim9, wherein the parameter information further includes capabilityinformation indicating capability requirements for providing thesupplemental content, and the method further comprises determiningwhether the reception apparatus is capable of providing the supplementalcontent based on the capability information.
 16. A non-transitorycomputer-readable storage medium having embedded therein instructions,which when executed by a reception apparatus, cause the receptionapparatus to perform a method of providing supplemental content, themethod comprising: receiving content from a broadcast source, thesupplemental content being associated with the content; receivingparameter information prior to providing the supplemental content, theparameter information including location information associated with thesupplemental content and timing information; obtaining the supplementalcontent based on the location information; and providing thesupplemental content at a timing determined based on the timinginformation.
 17. The non-transitory computer-readable storage mediumaccording to claim 16, wherein the method further comprises: receiving,from the broadcast source, triggering information; and retrieving theparameter information based on a resource location indicated by thereceived trigger information.
 18. The non-transitory computer-readablestorage medium according to claim 17, wherein the method furthercomprises: retrieving the triggering information from a predeterminedlocation of a transport stream.
 19. The non-transitory computer-readablestorage medium according to claim 17, wherein the method furthercomprises: retrieving the triggering information from a digitaltelevision caption stream.
 20. The non-transitory computer-readablestorage medium according to claim 16, wherein the method furthercomprises: receiving the parameter information via a unidirectionaltransport session.
 21. The non-transitory computer-readable storagemedium according to claim 16, wherein the parameter information furtherincludes additional data, and providing the supplemental content isperformed further based on the additional data included in the parameterinformation.
 22. The non-transitory computer-readable storage mediumaccording to claim 16, wherein the parameter information furtherincludes capability information indicating capability requirements forproviding the supplemental content, and the method further comprisesdetermining whether the reception apparatus is capable of providing thesupplemental content based on the capability information.